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Abstract. We propose a general classification of nonequilibrium steady states in 
terms of their stationary probability distribution and the associated probability 
currents. The stationary probabilities can be represented graph-theoretically as 
directed labelled trees; closing a single loop in such a graph leads to a representation 
of probability currents. This classification allows us to identify all choices of transition 
rates, based on a master equation, which generate the same nonequilibrium steady 
state. We explore the implications of this freedom, e.g., for entropy production. 
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Introduction. One of the greatest successes of statistical mechanics was forging 
the fundamental link between microscopic interactions and macroscopic behavior for 
interacting many-body systems in equilibrium. Boltzmann and Gibbs established the 
general framework which allows us to compute - at least in principle - any macroscopic 
observable of interest. Labeling the microscopic states ("configurations", C) of the 
system and establishing a form for the internal energy T~C(C) associated with each C, 
macroscopic observables can be expressed as statistical averages, (A) = J2c A(C)P eg (C), 
with the appropriate equilibrium distribution P eq (C). 

Given that a real system continuously undergoes transitions from one configuration 
to another, it is quite remarkable that P eq (C) can be determined without explicit 
recourse to a time- dependent distribution, P(C;t). At the root of this enormous 
simplification lies the property of detailed balance. Related to microscopic reversibility, 
a system evolving according to a dynamics with this property will eventually settle in a 
stationary state in which the net probability current between any pair of configurations 
vanishes. As a result, P eq (C) = lim^oo P(C; t) can be expressed in terms of ratios of 
the (dynamic) transition rates between configurations, and the long-time limit remains 
invariant under any modification of the dynamics which preserves these ratios. Indeed, 
Monte Carlo simulation studies of equilibrium systems rely heavily on this property. 

In summary, systems in thermal equilibrium are fundamentally well understood, 
including their dynamical representations. In stark contrast, a comparable theoretical 
framework is still sorely lacking for systems far from thermal equilibrium. Even the 



A possible classification of nonequilibrium steady states 



2 



simplest generalizations of thermal equilibrium, namely, non-equilibrium steady states 
(NESS), are currently analyzed case-by-case. Thus, much effort is directed at simple 
models, maintained far from equilibrium by imposing external driving forces, with the 
goal of identifying some generic classes of NESS jT| |2j. Typically, these models are 
specified by a set of transition rates (motivated by physical considerations), so that the 
master equation provides a natural framework for analysis. A key feature of far-from- 
equilibrium dynamics, these rates violate detailed balance, resulting in non-vanishing 
probability currents for the final, time-independent NESS. In general, its stationary 
distribution is not known a priori, and must be found by solving the master equation. 
Thus, it is impossible to discern if two different sets of rates will lead to the same 
NESS without solving both master equations. By contrast, for equilibrium systems 
with microscopically reversible dynamics, simply comparing the ratios of the rates will 
suffice! 

In this letter, we address these fundamental issues. Starting from a general 
master equation which admits a unique stationary distribution, P*(C), we first review 
a graphical construction for P* in terms of (directed) labelled trees. Established some 
time ago |S1 S Ej, this method seems not to be widely known. In this approach, the 
non-trivial probability currents associated with NESS are very naturally associated with 
the violation of detailed balance. Second, we propose a general classification of NESS 
in terms of both P*(C) and the (stationary) probability currents, K*(C,C), between 
configurations C and C. In other words, we postulate that a complete description for a 
NESS is {P*,K*}, being the appropriate generalization of the Boltzmann distribution 
for equilibrium systems: {P eq ,0}. In addition to the usual macroscopic averages (A), 
{P*,K*} allows us to compute fluxes of all physical quantities (e.g., mass and energy 
currents), within and through our system. In this framework, we can specify the class 
of transition rates which lead to the same NESS, leading to a generalization of the 
"detailed balance condition" routinely exploited in simulation studies of equilibrium 
systems. In other words, all transformations of the rates which leave {P*, K*} invariant 
are known. Further, if we are provided two distinct set of rates corresponding to the 
same NESS, then {P*,K*} can be found trivially. We conclude with a discussion of 
entropy production and some general comments. 

The master equation and graphic representation of P* . We begin with a generic 
master equation for an interacting many-body system with a finite number (N) of 
configurations. Labelling the configurations in some arbitrary fashion as Ci, C2, .., Cat, 
we write the transition rate, per unit time, from Cj to Ci as w{. All w's are real, non- 
negative, and assumed to be time-independent. In general, w\ differs from its reverse, 
w l j. The master equation for Pi(t) = P(Ci,t), the probability to find the system in 
configuration Ci at time t reads: 




(1) 



i.e., the off- and on-diagonal elements of W are just w\ and (— J2^j w i)- Note that 
J2iW- = 0, for V j, ensuring that J2iPi(t) = 1, for V t. Such a W is known as a 
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Figure 1. Representation of P-j*, for a simple model with TV — 3, in terms of directed 
labelled trees. 



stochastic matrix. Since equation (0) is just a continuity equation for probability, we 
can write K\ it) = wfPj(t) — WjPi(t) as the net probability current from Cj into Q. 

In the following, we assume that every configuration can be reached from every 
other configuration. Under these conditions, equation ([TJ is ergodic and has a unique 
stationary solution, P* = lim^oo Pi(t). The associated stationary currents are denoted 
by K*\ and satisfy ^j^K*? = 0, i.e., the total probability current into any given 
configuration vanishes. If the rates satisfy detailed balance, as for systems evolving 
towards thermal equilibrium where wj/wj = P^/Pj 9 , then all stationary currents 
vanish. An equivalent statement of detailed balance which does not reference P* q 
explicitly [2 J involves closed loops in configuration space, i.e., 

C n — > For each loop, we define the product of the associated rates in the "forward" 
and the "reverse" directions: 11/ = WjW J k ...w™' and il r = wjiUj ...w % n . The detailed balance 
condition corresponds to IT/- = IL, for all loops. Related to integrability, this property 
allows P* to be computed from the w's easily. 

In the absence of detailed balance, P* has to be found, in principle, from 
J2j W-P* = laboriously. Fortunately, there is a systematic way to construct P* (HIE!, 
using graph theoretical methods similar to those originally designed for electric networks 
jOJ. First, associate each Cj with a vertex, labelled i. Next, consider all distinct labelled 
trees (i.e., a graph consisting of all vertices with a single undirected edge between each 
pair, forming no loops). Denoting these trees as t a , a = 1,2,..,M, Cayley's theorem 
[Zj states that M = N N ~ 2 . To compute P*, direct every edge towards the vertex i and 
denote this subset of (directed) trees by t a uy In other words, a(i) runs over the set 
of directed trees with i as the "root". Next, a factor of w k is associated with an edge 
directed from n to k. Finally, to each tree t a ^, we assign a numerical value, U(t a ^), 
which is the product of the (N — 1) factors of u>'s in the tree. Clearly, U(t a ^) = if 
one of the associated rates vanishes. Then, the stationary distribution is given by 

P* = Z- l Y,U{t a{{) ) (2) 

a(i) 

where Z is just the normalization factor and may play the role of a (super-) partition 
function. We illustrate the procedure in figure 1 for iV = 3. A more detailed discussion, 
including further examples, can be found in jH]. 

Probability currents and loops in configuration space. From the defining equation 
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Figure 2. One term in [...] of equation J3J), illustrating the emergence of nontrivial 
loops. Straight arrows (red online) represent the w factors; the rest (black online), the 
U'b. 

for K{ above, we arrive at the net (stationary) probability current, from Cj into Cf 

K*{ = w{P; - w)P* = Z- 1 £ [w{U(t a(j) ) - wp(t a(i) )] (3) 

a 

Focusing on the expression within [...], we note that, for a specific a, the trees t a ^ 
and differ only in the directed edges that connect vertices i and j (figure 2). Now, 
multiplication of U{t a u^) by w\ can be regarded as adding a directed edge from j to i, 
converting t a u) into a graph with a single loop. Associated with this loop is the product 
Ili(t a (j)) = w{ (w\ 1 Wfa...Wj t> j, where hi, kg label the vertices between i to j. Similar 
considerations for w l jU(t a ^)) lead to a graph with the same loop, but traversed in the 
opposite sense and so, associated with IPj(t a ^) = Wj {w{ t ...w^. Meanwhile, the rest 
of both trees (the side branches of the loops) are identical, so that R{t a (i)) = R(t a ^), 
where R denotes the products of the w's in the side branches. Summarizing, we write 
WjU(t a (i)) = n*-(t a (j))i2(t a (j)), etc., so that 

K*{ = Z- 1 £ [Ui(t a(j) ) - DjCtoCo)] R(t a(t) ) (4) 

a 

This expression explicitly demonstrates the emergence of nonzero steady state 
probability currents from rates which violate detailed balance, as manifested in 
irreversible loops. 

A postulate. It is easy to construct cases where two sets of rates, one obeying 
detailed balance, and the other violating it, lead to the same stationary distribution. For 
example, for particles hopping on a ring with symmetric or biased rates, P eq = P* oc 1. 
Hence, one might be tempted to consider any P* as an "effective" equilibrium system. 
Indeed, nothing prevents us from labeling — lnP*(C) as an "effective Hamiltonian" . Yet, 
in the simple example above, the system with biased rates carries a physical current 
while the system with symmetric rates does not. Thus, it is essential to identify a 
key signature that distinguishes a NESS from an equilibrium state. We believe that 
the nonvanishing stationary currents, K*, fill this role. Therefore, we propose that 
{P*,K*} form a complete and unique description for any stationary state. The major 
difference between a NESS and the standard equilibrium case is K* being nonzero. In 
this sense, the class of NESS is significantly broader than equilibrium states, and their 
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analogs in electrodynamics would be, respectively, magnetostatics and electrostatics. 
Given {P*,K*}, all macroscopic stationary properties of the system can be computed. 
Beyond the usual averages with P* as the weights, the K* generate average fluxes 
(or currents) associated with physical observables, such as energy or particle number 
density. More details and examples will be discussed elsewhere jH]. 

Dynamic equivalence classes. A common notion of NESS is that, unlike their 
counterparts in thermal equilibrium, seemingly slight modifications of the rates lead 
to very different steady states. Armed with our characterization of a NESS in terms of 
{P*, K*}, we can pose a natural question: What determines the class of dynamics that 
leads to the same NESS? In other words, given a set of to's and its associated NESS, 
what are the transformations (on the rates) which leave {P*,K*} invariant? For the 
equilibrium case, {P eq , 0}, the answer is well known: Any set of w's will lead to a desired 
P eq , provided they satisfy the "detailed balance condition": wj/wj = P^/Pj 9 . This 
can be regarded as a constraint on the w's, given a certain P eq is to be achieved. In our 
framework, this constraint can now be easily generalized: To arrive at a given {P*, K*} 
final state, the w's must satisfy 

wjp; - w)p; = k*{ . (5) 

for all pairs % ^ j. In the remainder of this letter, we will explore other representations 
of this constraint and some of its implications. 

Let us decompose WP* into its symmetric and antisymmetric parts: 

"•//>; =S{ + A> (6) 

where S = (WP* + WP*)/2, and A = (WP* - WP*)/2. Then equation © is just the 
constraint that A is fixed to be K*/2. In contrast, there is no such constraint on S, 
except for two restrictions. The physical rates must be non- negative (w > 0), leading 
to 5*/ > \Aj\, Vi ^ j. Next, probability conservation imposes J2% $i = 0, V j. Thus, we 
arrive at the conditions 

Sl>l\K*i\ Vz^j, Sj £ .S/ . (7) 

Within these constraints, we can choose arbitrary S"s and construct the associated 
transition rates via 



W? 



si + \k*\ 



(p;y x , (8) 



resting assured that the final NESS will remain the same. Thus, we may associate such 
S"s with an "equivalence class" of dynamical rates leading to the same given NESS. 

It is very instructive to consider the difference, A^, between two sets of rates that 
belong to the same class. Since the differences in the S"s are symmetric, A must satisfy 

AjP* = A)P* . (9) 

Reminiscent of the ordinary detailed balance condition, it is possible to turn this into a 
mnemonic: "The differences (as opposed to the rates themselves) must satisfy detailed 
balance with respect to P*." Finally, we note an implication of this curious equation: If 
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two sets of rates are somehow known to generate the same NESS, their (non-vanishing) 
differences will provide a simple route to finding P*. In contrast, for equilibrium states, 
the stationary distribution can be easily generated from just one set of rates, again due 
to the known absence of K*'s in this case. 

Entropy production. One of the key signatures of nonequilibrium steady states, 
recognized over three decades ago HI [TU] , is entropy production. For a general time- 
dependent solution of the master equation, two independent quantities were introduced: 
the entropy production of the "system" and of the "medium" , 

S sys ee £ WiPjit) In -fi± , S med ee £ WiP s {t) In . (10) 

The former is readily recognized as the time derivative of S sys = — J2i Pi(t) In P%(t) , 
which motivates the term "entropy production of the system" . The latter is attributed 
to the coupling of the system to the external environment in a manner that prevents it 
from reaching equilibrium [3]. Neither S sys nor S me d is necessarily positive. However, 
their sum, naturally termed the "total entropy production" 

is indeed non-negative |3]. 

Recasting these expressions in terms of the probability currents |1], and taking 
t — > oo to focus on stationary states, we arrive at S* sys = | K*{ hi (Pj I Pf) an d 
Smed = ^J2i,jK*l\ia{W-/Wj). For equilibrium states, both trivially vanish since all 
currents are zero. By contrast, K* ^ for a NESS, though S* ys remains zero (so that 
S med = S( 0t ). The interpretion of these results is clear: In the steady state, the entropy 
"associated with our system" no longer changes. However, it is reasonable to expect 
that, being coupled in an irreversible way to the environment, such a NESS continues to 
"induce" the entropy of its surrounding medium to increase (indeed, S med = S^ ot > 0). 
In this sense, S med carries detailed information of transition rates and so, the precise 
nature of the coupling between our system and its environment. As a result, even if we 
insist on having the same NESS (i.e., a given {P*,K*}), S med will not be unique. Let 
us explore the implications of these "degrees of freedom" . 

Since S med = S* ot , we focus on the latter and exploit equation (0): 

1 qi _i_ A j 

i,j 

Since A = K*/2, the freedom we have is any S satisfying equation (J7J). An immediate 
consequence is that rates can be chosen to minimize the entropy production (associated 
with a given NESS), by having S ^> A. To lowest order in K*j/Sf, we have 
Stot = Y^(K*) 2 1 (2S). Since S^ ed = for equilibrium cases, we can choose rates 
which are arbitrarily "equilibrium-like" in this respect. We should emphasize that, 
though S^ ot can be made arbitrarily small, it remains strictly positive and retains 
the NESS signature. At the opposite extreme, we can consider rates with "infinite 
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^med" by lowering some Sj to A\ . Whether such a concept is useful deserves further 
exploration. It is natural to label such rates as "maximally asymmetric" , since one of 
the two directed edges between some pairs of configurations is missing. Such models 
abound in the literature, e.g., totally asymmetric exclusion processes (TASEP) [TT| . 
One clear advantage of having maximally asymmetric rates for all edges is that the 
number of trees used for constructing P* is kept at the absolute minimum. Of course, 
the expression for K* also simplifies. Finally, the implications for non-equilibrium work 
theorems ^21 EH] are not trivial and will be published elswhere |H|. 

Conclusions. To summarize, we have addressed a fundamental question associated 
with non-equilibrium steady states: Within the framework of the master equation, what 
class, if any, of transition rates W lead to the same stationary state? For equilibrium 
systems, the answer is provided by the detailed balance condition. To generalize this 
answer to NESS, we first postulate that a NESS is completely and uniquely specified 
by its stationary distribution P* in conjunction with the steady currents K*. Then 
the generalized detailed balance condition is simply equation (jSJ). Exploiting a graphic 
method to compute P* in terms of directed labelled trees, we display the connection 
between K* and "irreversible" loops - key characteristics of rates that violate detailed 
balance. Extensions, examples, and further implications of these explorations may be 
found in jH]. 
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